The computational difficulty of finding MPS ground states 
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We determine the computational difficulty of finding ground states of one- dimensional (ID) Hamil- 
tonians which are known to be Matrix Product States (MPS). To this end, we construct a class of 
ID frustration free Hamiltonians with unique MPS ground states and a polynomial gap above, for 
which finding the ground state is at least as hard as factoring. By lifting the requirement of a unique 
ground state, we obtain a class for which finding the ground state solves an NP-complete problem. 
Therefore, for these Hamiltonians it is not even possible to certify that the ground state has been 
found. Our results thus imply that in order to prove convergence of variational methods over MPS, 
as the Density Matrix Renormalization Group, one has to put more requirements than just MPS 
ground states and a polynomial spectral gap. 



Explaining the behaviour of correlated quantum many- 
body systems is one of the major challenges in physics 
and fundamental to the understanding of condensed mat- 
ter systems. The exponential dimension of the under- 
lying Hilbert space renders a straightforward numeri- 
cal simulation impossible both with respect to compu- 
tational time and storage space. However, for specific 
physical scenarios simulation methods have been devel- 
oped; in particular, the Density Matrix Renormalization 
Group (DMRG) method [HQ has proven extremely suc- 
cessful in describing ground and thermal states of one- 
dimensional spin systems, and to some extent even their 
time evolution, to very high accuracy. 

DMRG has a natural interpretation as a variational 
ansatz over the class of Matrix Product States (MPS) [3| , 
and it has been proven that every ground state of a lo- 
cal gapped Hamiltonian can indeed be approximated ef- 
ficiently by MPS [i| . While this explains why MPS are 
well suited to describe ground states of one-dimensional 
quantum systems, essentially nothing fundamental con- 
cerning the convergence of the variational method over 
the class of MPS could be shown, despite the fact that 
in practice, it converges extremely well. Actually, given 
the type of optimization problem at hand, one is rather 
tempted to believe that DMRG will typically get stuck 
in local minima, and in fact it has been shown that if the 
optimization is performed in a specific way where sites 
are optimized simultaneously, configurations might oc- 
cur where the optimization problem becomes NP hard, 
meaning the algorithm would get stuck Yet, this dif- 
ficulty is solely due to the specific way in which the opti- 
mization is performed, rather than being a fundamental 
problem of any variational method over MPS. 

As we show in this paper, however, under natural as- 
sumptions on the Hamiltonian obtaining a sufficiently 
good MPS approximation to the ground state, and in 
particular finding the minimum in DMRG, is a compu- 
tationally hard problem, i.e., can in the worst case take 
exponential time. More precisely, we construct a class 
of nearest neighbor Hamiltonians on a one-dimensional 
chain of length L with the following properties: Any 



of those Hamiltonians has a unique ground state with 
a spectral gap of order l/poly(£) above, it is frustra- 
tion free (i.e. the ground state minimizes each local term 
of the Hamiltonian), and the ground state is a Matrix 
Product State of size polynomial in L, as are the low- 
lying excited states. For these Hamiltonians, we show 
that finding the ground state (or a polynomial-accuracy 
approximation thereof) is a hard problem, as it e.g. en- 
compasses factoring numbers. This implies that finding 
an MPS approximation of these ground states most likely 
cannot be solved efficiently by classical computers. 

By considering a slightly less restricted class of Hamil- 
tonians, we obtain further results. In particular, if in- 
stead of requiring a unique MPS ground state we allow 
for a ground state subspace spanned by MPS while keep- 
ing the polynomial energy gap, and instead of frustration 
freeness require the ground states only to be eigenstates 
to each local term, we obtain a class of Hamiltonians for 
which finding the ground state is an NP-complete prob- 
lem. This implies that for this class, it is even impossible 
to certify that the ground state has been found, based on 
widely believed complexity theoretic assumptions. More- 
over, it follows that there cannot even be a DRMG-like 
algorithm which works at least for frustration-free sys- 
tems, since this would allow for the efficient solution of 
NP-complete problems. 

Let us start by briefly introducing Matrix Product 
States (MPS) and their entanglement properties. An 
MPS on a length L chain of (i-level systems ("spins") 
with bond dimension D is given by 
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where the are D x D matrices. MPS satisfy the 
entropic area law, i.e., the entanglement across each cut 
is bounded by log-D, and they efficiently approximate 
ground states of gapped local Hamiltonians 4] . 

The classical complexity class NP contains all decision 
problems where for "yes" instances, an efficiently check- 
able proof can be found, as e.g. colorability of a graph. 
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A problem is said to be hard for a class if any problem 
in this class can be reduced to solving this very prob- 
lem, and complete if it is additionally inside the class. 
While NP-hardness of a problem strictly speaking does 
not prove that it cannot be solved efficiently, it is the best 
we can hope for, given that showing whether NP 7^ P, 
although generally believed to be true, is one of the most 
important open questions in complexity theory. 

To construct hard ground state problems for DMRG, 
we start from the LOCAL hamiltonian problem and the 
corresponding complexity class QMA (Quantum Merlin 
Arthur). QMA contains those decision problems where 
for "yes" instances, there is a quantum proof which can 
be checked efficiently by a quantum computer, and is 
thus the natural quantum generalization of NP. More 
precisely, in the definition of QMA there are thresh- 
olds p > q: for "yes" instances, there is a proof which 
will be accepted with probability at least p, whereas for 
"no" instances, no attempt to provide a fake proof will 
succeed with probability more than q. It is sufficient to 
require p — q > l/poly(iV) (with N the problem size), 
since then, the probabilities can be amplified up to expo- 
nentially close to 1 and 0, respectively [6(. As shown by 
Kitaev [f|[3], the problem local hamiltonian is com- 
plete for QMA: Given a local Hamiltonian on N spins 
(where in this case local means it is a sum of few-particle 
terms), decide whether the ground state energy is below a 
or above b, with b — a > 1 /poly(iV) . It is easy to see that 
this problem is in QMA — the proof is the ground state 
(or several copies thereof), and the verifier estimates the 
ground state energy by measuring the local terms. 

Let us now review Kitaev's construction for proving 
QMA-hardness of LOCAL hamiltonian. The task is, 
given a polynomial-size quantum circuit (the verifier), 
to construct a local Hamiltonian for which the ground 
state energy is at least l/poly(iV) lower if there exists a 
satisfying input to the circuit, i.e., a valid proof. To this 
end, write the verifying circuit using T = poly(A r ) one- 
and two-qubit gates Ut, and for each valid input |<fo) to 
the circuit construct a state which encodes the history of 
the verifier checking this very input, 



a which is not properly initialized, 
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where d denotes the data register [initially, the first 
part holds the input \4>q) and the second poly(TV) an- 
cillas which are initialized to |0 . . . 0); it thus consists of 
AI = poly (A 7 ") qubits] and t the time register. Now, con- 
struct a Hamiltonian which penalizes wrong proof histo- 
ries, 

H = -ffinit + H cvo \ + -f/final , (2) 

where flinjt = TJ2 a I l)a (1 1 ® |0)j(0| penalizes any ancilla 
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ensures that the transistions between t — 1 and t in \ip) 
are correct, and i/fmai = |0)i(0| ® \T) t (T\ penalizes the 
state |0) on the very first qubit — it will be set to |1) if 
the circuit accepts the proof. It has been shown that if 
there exists a proof which will be accepted by the verifier 
with high probablity, the ground state energy of (J5J) is 
by 1 /poly (AT) lower than if there is no such proof. The 
intuition is that in the former case, the state |T]) almost 
does the job, while in the latter case, at least one of the 
terms in the Hamiltonian (or a superposition thereof) has 
to be violated. 

In general, the spectral properties of |J2]) will be compli- 
cated since from to the definition of QMA, there can be 
many potential witnesses with different acceptance prob- 
abilities. In the following, we will restrict to problems 
where inputs to the verifier are either accepted of rejected 
deterministically if choosen from the proper basis, and 
this will simplify the spectrum remarkably. Actually, we 
go even further and consider classical deterministic veri- 
fiers, corresponding to problems in the complexity class 



NP [12j, which will finally give rise to the simple entan- 



glement structure of the ground state we are after. 

To determine the spectral properties of ([2]) for a classi- 
cal deterministic circuit, let us fix a classical initial state 
of the data register \a)d — \a\ . . . ajw)d an d analyze the 
system on the T + 1-dimensional space Ti. a spanned by 
\Xt) — Ut ■ ■ ■ Ui\a)d\t)t, which is closed under the action 
of H init , fffinai and H cmh In particular, 
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with A = 0,1,2... the number of wrongly initialized 
ancillas in \a)d and B = 0, 1 depending on whether the 
circuit accepts or rejects the input \a)d- In the case of a 
"yes" instance of the NP problem, there exists an \a)d 
for which A = B = 0, whereas for "no" instances, the 
lowest-reaching subspace has A = 0, B = 1. In both 
cases, the eigenfunctions are 



VP a 



= C^cosK(i+i)]|x t ) , n = 0,...,T, (4) 
t=o 

where uj n = w° = mr/(T + 1) for A = 0, B = and uj n = 
u\ = (n + §)7r/(T + §) for A = 0, B = 1, respectively; 
in both cases, the eigenvalues are given by A„ = 2(1 — 
cosw„), and C 2 = 9(1/T) 0. 

Different from QMA-completeness proofs, we are not 
interested in the difference in ground state energy be- 
tween "yes" and "no" instances but rather in the spectral 
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gap for each of the cases independently. Analyzing the 
spectrum will be simplified a lot by the fact that the sub- 
spaces TC a are closed under the action of any term in the 
Hamiltonian, which is due to the restriction to classical 
deterministic circuits. 

We start by analyzing H for a circuit corresponding 
to a "yes" instance of the NP problem. Then, there is 
at least one initial state \a^)d such that H ao has A = 
B = in ([3|), and since H > 0, this subspace contains 
a ground state. There are two different types of excited 
states: The ones within H ao , which have a gap 2 (cos Wq — 
cos uii) = f2(l/T 2 ), and those within another Tt a for 
which A and/or B are strictly positive. The energy in any 
of these subspaces is bounded by the ground state energy 
for A = 0, B = 1, and is thus f2(l/T 2 ) as well, proving an 
f2(l/T 2 ) spectral gap of the overall Hamiltonian. Note 
that the degeneracy of the ground state manifold equals 
the number of different accepted inputs. 

On the other hand, for "no" instances there is no sub- 
space with A = B = 0. It is easily seen that the ground 
state subspace has A = 0, B = 1, with ground state 
energy 2(1 — cos Wg) and an f2(l/T 2 ) gap within the sub- 
space. In order to bound the gap to subspaces with A > 1 
(for which B can be 0), we use the following lemma, 
shown in Given finite-dimensional operators P > 0, 
Q > with null eigenspaces, 

P + Q > min{A(P), A(Q)}(1 - cos 0) , (5) 

where A(0) > is the smallest nonzero eigenvalue of O, 
and 9 the angle between the null spaces of P and Q. It 
follows that the lowest eigenvalue in an A = 1, B = 
subspace is at least T(l - cos - V /T/(T+ 1)), and 

thus any subspace with A > 1 has an energy f2(l/T 2 ) 
above the ground state. 

An important point to observe is the particularly sim- 
ple entanglement structure of the eigenstates ([4]) of H, 
which in ID will allow to represent them as MPS. To see 
this, take any classical reversible verifying circuit and de- 
compose it into a sequence of local gates. Let us first 
allow for three-qubit gates, so we can use the Toffoli 
gate which is universal for classical reversible compu- 
tation. Since it is a classical gate, each of the states 
\a(t)) = Ut ■ ■ ■ Ui\a)d is classical itself, and thus each of 
the eigenstates (J4j) is a superposition of only T + 1 clas- 
sical terms \a(t))\t) = \xt)- As we want to restrict to 
two-qubit gates, each Toffoli gate has to be implemented 
using a short sequence of entangling two-qubits gates. 
This temporarily creates entanglement between the three 
neighboring qubits on which the Toffoli is applied, thus 
adding some entanglement to the eigenstates. However, 
this entanglement is both spatially and "temporally" re- 
stricted, since it only involves three qubits and it only 
persists over a few timesteps. 

Let us now turn towards one-dimensional systems, 
where we will employ the one-dimensional QMA- 
complete Hamiltonian construction of Aharonov et al. [8| . 



Since the restriction to one-dimensional local Hamilto- 
nians makes it impossible to access a global time reg- 
ister, the time is encoded in the position of the data 
register. To this end, the data register is realized se- 
quentially T + 1 times in the ID system [which thus 
consists of L = M(T + 1) = poly (AT) sites], and with 
each timestep, the active register moves to the right. To 
mark which is the active register and to implement a 
Hamiltonian ([2]), a control register is appended to each 
qubit. It is used both to store the status of the regis- 
ter (i.e., used/active/unused) and to implement an in- 
volved scheme in which a head is moving back and forth, 
thereby first implementing the desired operation Ut on 
the active register and then, qubit by qubit, copying it 
to the next timeslice. Thereby, each original i-timestep 
is encoded in K = 0(M 2 ) elementary movements of the 
head ("r-timesteps"), replacing the original T steps by 
T = KT = poly(iV) steps of the encoded system. The re- 
sulting local dimension per site is 12 (achieved by remov- 
ing the data qubit degree of freedom e.g. for non-active 
blocks), and the resulting Hamiltonian acts on nearest 
neighbors only. 

As before, the Hamiltonian is a sum of transition rules 
^ovoi (now encoding the elementary movements of the 
head) and of penalties -f/mit and -f/finai for undesired ini- 
tial and final configurations, acting on the blocks corre- 
sponding to t — and t — T, which are applied when the 
head moves over the qubit. Additionally, one now has 
to make sure the system stays in the subspace of allowed 
configurations of the status register, excluding e.g. the 
occurence of more than one head. This is achieved by 
adding a sum of local penalty terms -ffpenaity acting on 
the status register, which either penalize forbidden con- 
figurations directly or indirectly as they evolve to penal- 
ized ones under H cvo i. For details on the implementation, 
see Q. 

To analyze the spectral properties of the ID Hamil- 
tonian, we apply the "clairvoyance lemma" of Ref. Q 
which tells us that we can restrict our attention to the 
subspace of valid configurations of the status register. 
Therefore, split the the total Hilbert space into subspaces 
K-s spanned by minimal sets of classical status register 
configurations S closed under H QVO i; data degrees of free- 
dom are left unrestricted. By definition, these subspaces 
are also closed under Hpenaity There is one subspace 
K-o which contains only valid configurations, whereas all 
other ICs contain only illegal configurations. The clair- 
voyance lemma shows that although some of these con- 
figurations might not be directly detected by H pena i ty , 
the minimal energy of H evo \ + -Hpenaity, restricted to any 
of these subspaces, is fi(l/T 3 ), and since flinit > and 
i^finai > act on the data register and thus within the 
subspace, they do not affect this lower bound. By multi- 
plying -//penalty by T 2 , we can boost this to f2(l/T) which 
will be sufficiently above the low- lying eigenstates in /Cq. 
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On the subspace /Co, -Hpenaity vanishes and we can pro- 
ceed as before: We choose an initial classical configura- 
tion a of the data register and consider the system on 
the resulting subspace span{|x ), . . . , \xr)}- There, it is 
described by a Hamiltonian very similar to ([3]) , except for 
minor differences in the implementation of H ln it' While 
i^finai can well be applied in the very last r-timestep on 
the rightmost data qubit and thus give the same penalty 
term B = 0, 1 in ((3]), the penalties enforcing properly 
initialized ancillas can appear in the first M r-timesteps, 
i.e., a penalty T can show up in any of the first M di- 
agonal entries of ([3]). Since this only increases in (O 
and thus the gap, we obtain the same spectral proper- 
ties as before (but we alo have to use the lemma for the 
"yes" instances). Note that in particular, all energies are 
well below the energy of any subspace ICs with illegal 
configurations. 

Let us now investigate the entanglement structure of 
the low-lying eigenstates which are of the form ((4|) , but 
in the one-dimensional encoding. As before, there are 
two sources of entanglement: On the one side, we have 
a superposition of all r-timesteps, i.e., of T = poly (TV) 
states. Each of them is almost classical, with the only 
source of entanglement being one Toffoli gate which is 
performed. As this involves three qubits, each of these 
states is a superposition of at most 8 classical states, and 
thus all low energy eigenstates of the one-dimensional 
Hamiltonian can be written as a superposition of poly(A) 
classical states. It follows immediately that the ground 
state can be represented by an MPS with bond dimen- 
sion D = poly (A). Note that the bond dimension ac- 
tually needed is considerably smaller than the number 
of classical states, since e.g. the superposition of 0(M 2 ) 
states which arises from encoding the t t + 1 transi- 
tion in 0(M 2 ) r-timesteps ranges over two consecutive 
i-timeslices and thus 2M sites only. 

We have shown that if the one-dimensional QMA con- 
struction of [|| is applied to problems from the class NP, 
the resulting Hamiltonian has a polynomial gap, and the 
low-lying eigenstates are MPS. Let us now see what this 
implies for the difficulty of finding ground states of one- 
dimensional systems. Firstly, let us encode the verifying 
circuit for an NP- complete problem in the Hamiltonian. 
Thereby, we obtain a polynomially gapped Hamiltonian 
for which the ground state manifold is spanned by MPS, 
and for which finding a ground state — or even an approx- 
imation within an accuracy sufficiently smaller than the 
gap — is an NP-hard problem. Note that obtaining the 
MPS representation of the ground state is indeed stronger 
than just deciding the NP problem itself, since from it 
one can efficiently extract the satisfying assignment. 

Let us now construct Hamiltonians with a unique 
ground state. In order to have a unique ground state 
for all instances, we have to restrict to problems which 
do not only have unique proofs for "yes" instances, but 
also unique disproofs for "no" instances, or more formally 



problems in NPiHcoNP with unique proofs (coNP is the 
class of problems where "no" instances can be disproven) . 
Although this is likely to be a smaller class than NP, it 
still contains interesting hard problems 0] . In particular, 
finding the prime factor decomposition of a given number 
corresponds to a problem in this class: The prime fac- 
tor decomposition always exists, it is unique, and since 
primality testing is in P, it can be efficiently checked 
whether a given decomposition is indeed the prime fac- 
tor decomposition. The corresponding Hamiltonian has 
an MPS as its unique ground state, a polynomial gap 
above it, it is frustration free since there is always an 
accepting input, and approximating the ground state by 
an MPS is at least as hard as factoring; in particular, 
the prime factor decomposition itself can be read right 
off the MPS representation of the ground state. 

Beyond the direct implications on the hardness of find- 
ing MPS ground states, our results also provide strong 
evidence against the existence of a certifyable version of 
DMRG. The idea behind certify ability is that even if an 
algorithnm does not always converge to the true ground 
state, in the cases where it succeeds this can be certified. 
To see why no variational method over MPS can be cer- 
tifyable, take again an NP-complete problem encoded in 
a one-dimensional Hamiltonian. On the one hand, for 
any "yes" instance success can be readily checked as the 
Hamiltonian is frustration free. However, if it was pos- 
sible to certify the ground state for "no"-instances, this 
would be a way to provide an efficiently checkable certifi- 
cate that one is facing a "no" -instance for any problem 
in NP, and would therefore prove NP — coNP, which 
is considered unlikely. 

Finally, since the Hamiltonian for a "yes" -instance 
is always frustration free, one cannot even hope for a 
DMRG algorithm which only works for frustration free 
Hamiltonians. Otherwise, run the algorithm on any in- 
stance of an NP problem and check the energy of the 
state returned: for a "yes" instance, the Hamiltonian is 
frustration free and thus the energy is 0, whereas "no" in- 
stances can be easily detected due to their larger ground 
state energy. Thus, the existence of such an algorithm 
would allow to solve NP-complete problems in polyno- 
mial time. 

Note that our construction to obtain NP-hard ground 
state problems with simple spectral properties will work 
for any QMA scheme, as all of them are based on Ki- 
taev's original construction. For two-dimensional Hami- 
tonians this is less interesting since there exist hard clas- 
sical Hamiltonians; however it might be interesting to ap- 
ply it to the translational invariant constructions of [10( • 
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